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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is spedfied above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 )□ Responsive to communication(s) filed on . 

2a)n This action is FINAL. 2b)K This action is non-final. 

3) G Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) E Claim(s) 1-10 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) n Claim(s) is/are allowed. 

6) ^ Clalm(s) 1-10 is/are rejected. 
?)□ Claim(s) is/are objected to. 

8) D Claim{s) are subject to restriction and/or election requirement. 

Application Papers 

9) ^ The specification is objected to by the Examiner. 

^0)M The drawing(s) filed on 13 February 2002 is/are: a)EI accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .121(d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12)^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
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1 .Q Certified copies of the priority documents have been received. 
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application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 
Specification 

1 . The title of the invention is not descriptive. A new title is required that is clearly 
indicative of the invention to which the claims are directed. 



Claim Rejections - 35 (JSC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351 (a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 

3. Claims 1-10 are rejected under 35 U.S.C. 102(e) as being clearly anticipated by 
Hoory et al. (U.S. Pat. 6.785,649). 

As per claims 1, 7, 9 and 10, Hoory teaches a method, apparatus, computer- 
readable recording medium and program for processing information, comprising: 

extracting infomiation expressing a characteristic of speech information 
(determines word rate, volume and pitch, Fig. 2, elements 34, 36, and 38); 

converting the speech information to character data (converts speech to text, Fig. 



2, element 32); and 
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subjecting the character data to prescribed processing based on the infomiation 
expressing the characteristic (speech characteristics are mapped to text format 
characteristics and associated with the generated text, col. 6, lines 34-37). 

4. As per claim 2, Hoory teaches the prescribed processing changes a character 
form of the character data (speech characteristics are mapped to different text fonts and 
sizes, table 1 ). 

5. As per claim 3, Hoory teaches the prescribed processing changes a control code 
of the speech information (performs a mapping to map the speech characteristic to a 
code that controls the text format, col. 6, lines 50-64, and Table 1). 

6. As per claim 4, Hoory teaches the extracting step extracts information expressing 
an emotion from the speech information (determines word rate, volume and pitch, the 
emotion of a voice is characterized by its rate, volume or pitch, for example someone 
who is angry would speak at a high volume while someone who is nervous would speak 
at a high speech rate, hence these speech characteristics express an emotion, Fig. 2, 
elements 34, 36, and 38). 

7. As per claim 5, Hoory teaches sending the character data processed by the 
prescribed processing to a network (encodes the expressive text and transmits it to a 
receiver, col. 5, lines 40-47). 

8. As per claim 6, Hoory teaches a method for processing information including 
character data, comprising: 

extracting from the character data at least a prescribed character code and one 
of a prescribed word and a prescribed phrase as prescribed information (converts text 
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to speech so it must extract a word or phrase and extracts non-verbal characteristics 
from the text uses the mapping to determine the character code, col. 9, line 58 to col. 
10, line 7): 

converting the character data to speech information (converts text to speech, col. 
9, line 58 to col. 10, line 7); and 

subjecting the character data or speech information to prescribed processing 
based on the extracted prescribed information (produces speech with non-verbal 
characteristics, col. 9, line 58 to col. 10, line 7), 

wherein the prescribed processing performs either processing to add a word 
expressing an emotion or processing to perform conversion to a word expressing an 
emotion (synthesizes speech according to non-verbal characteristics hence converting 
the word to express the emotion, col. 9, line 58 to col. 10, line 7). 
9. As per claim 8, Hoory teaches an information transmission system, comprising: 

a first infonnation processing apparatus, which captures input information, 
extracts information expressing a characteristic of the input information (detenmines 
word rate, volume and pitch. Fig. 2, elements 34, 36, and 38); 

changes the input infonnation to character data (converts speech to text, Fig. 2, 
element 32); 

subjects the character data to prescribed processing based on the information 
expressing the characteristic (speech characteristics are mapped to text format 
characteristics and associated with the generated text, col. 6, lines 34-37); 
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sends the character data subjected to the prescribed processing to a network 
(encodes the expressive text and transmits it to a receiver, col. 5. lines 40-47); 

a second information processing apparatus, which receives character data via 
the network, extracts prescribed information from the character data (receiver decodes 
marked-up text as expressive text and uses the non-verbal characteristics in synthesis 
hence extracting them, col. 5, lines 44-53); 

changes the character data to other information (converts expressive text back to 
speech, col. 5, lines 50-53), and 

subjects the character data or other information to prescribed processing based 
on the extracted prescribed information (synthesizes the speech from text using the 
non-verbal characteristics, col. 5, lines 50-53). 

Conclusion 

10. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Abe (U.S. Pat. 5,940,797) and Holm et al. (U.S. Pat. 6,260,016) 
teach methods for speech synthesis using information extracted from the text. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to IVIatthew J Sked whose telephone number is (703) 305- 
8663. The examiner can normally be reached on Mon-Fri (8:00 am - 4:30 pm). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Talivaldis Smits can be reached on (703) 306-301 1. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more infomnation about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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